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1 Introduction 

Infinite Matrices. In this paper, we look at truncation methods for the approximate 
solution of certain operator equations Au = b on the space E := £ P (Z , X) of functions 
u : Z N ->• X with 



rl £ Hk)\P, pe [l,oo) 
sup |ii(fc)|, p = oo 

k&Z N 



< oo, 



where N G N, p G [1, oo] and X is an arbitrary complex Banach space. The operators A 
that we have in mind are bounded linear operators E — > E which are induced, via 



by a matrix (dij)ij£z N with operator entries a,ij : X — > X. Among those operators we call 
A a band operator if it is induced by a banded matrix, i.e. = if |i — j \ is large enough, 
and we call A a band-dominated operator and write A G BDO(-E) if A is the limit, with 
respect to the operator norm induced by the norm on E, of a sequence of band operators. 
Also for A G BDO(E'), there is a unique (see [18, §2.1.2] or [10, §1.3.5]) matrix (a^j j e z N 
which induces A via (1); we denote it by [A]. 



Finite Sections. If A G BDO(E') is invertible then Au = b has a unique solution 
u G E for every right-hand side b G E. An exact computation of u, however, is in general 
not possible which is why one uses approximation methods. One of the most popular 
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approximation methods is as follows: Choose a sequence Q± C SI2 C • ■ ■ of finite subsets 
of that eventually covers every point of 7L N and replace the infinite system 

Au = b i.e. aiju(j) = b(i), i £ Z N 

by the sequence of finite systems 

<HjUn(J) = &(*), iefi„, (2) 

for n = 1, 2, ... . This procedure is called the finite section method (FSM). The FSM is 
called applicable if there exists an no G N such that, for every b G E 1 , (2) is uniquely 
solvable for all n > no and if the sequence (u n ) of solutions is bounded in E and converges 
componentwise to the exact solution u of Au = b as n — ?• 00. 

Here is how we will choose the finite sets Oi, f^, ••• in (2): 

Definition 1.1 We u>iZZ say i/tai C is a valid starlike set ifQ is bounded, nonempty 
and has the property that, for every x G f2 and a G [0, 1), arc is an interior point of VL. 

So in particular, is an interior point of every valid starlike set. Moreover, all bounded 
convex sets O C M. N with interior point are valid starlike sets. Now, for every n G N, 
put 

n n := nn n Z W and P n := P n „, (3) 

where, for a set {/ C Z N , by P;y : E — > E we denote the operator of multiplication by the 
characteristic function xt/ of U. Then we can abbreviate (2) as 

P n AP n u n = P n b, n = l,2,.... (4) 

This truncation procedure is a very natural idea and the fact that it can be performed on 
all infinite matrices creates the temptation to simply use it and keep fingers crossed it will 
work. A positive outcome, however, i.e. applicability as defined above, is in general far 
from guaranteed. Here is the probably most elementary example for which the FSM fails 
to apply: 

Example 1.2 Consider the shift operator A = V c : u 1— > v on E with u(k) = v(k + c) for 
every k G Z N and a fixed nonzero vector c G Z N . Then V c is invertible on E but since 
V c maps functions with support in Q n to functions supported in f2 n + c, the truncated 
equation (2) alias (4) is not solvable for general right-hand sides (and even if it is solvable, 
the solution is not unique) - no matter how big n is and how Q is chosen. □ 

Here is a slightly more sophisticated example: 

Example 1.3 Let N = 1 and consider the operator A induced by the block diagonal 
matrix 

diag ('"'(i o)'(i o)'(i 0)'"') 



2 



with the single 1 entry at position zero. Then A = A 1 is invertible and, for Q, = [—1,1], 
its truncations P n AP n correspond to the finite (2n + 1) x (2n + 1) matrices 

-((?;M-M-M-)) 

if n is even and to 

;)■■■■(! iW! ;)■■■■(! ;)•») 

if n is odd. So the FSM (4) is not applicable since all operators P n AP n \- im p n with an odd 
n are non-invertible. □ 

By [10, Corollary 1.77] (which is a consequence of [18, Theorem 6.1.3]) one has that 
the FSM (4) is applicable iff A is invertible and the sequence 

(P n AP n + Q n )„ eN (5) 

is stable. Here we have put Q n := I — P n and we call a sequence (A n ) ne ^ of operators A n : 
E — > E stable if there exists an no S N such that all operators A n with n > uq are invertible 
and sup n>riQ ||^4^' 1 || is finite. Also note that P n AP n + Q n is invertible on E iff P n AP n is 
invertible on the image of P n and that ||(P n AP n + Qn) -1 || = max(l, ||(P n ^4P n |i m p n ) _1 ||). 



The aim of this paper is to demonstrate two strategies, originally developed in [20, 12] 
and [5], that can be used if the FSM (4) is not applicable: 

Strategy 1: Pass to a subsequence. As we have just seen, the finite section 
method cannot be expected to work for every operator A. But in some cases it is possible 
to "adjust" the method to the operator at hand by choosing the right geometry Q and 
an appropriate subsequence of (5). The philosophy here is to give the operator A the 
chance to impose some of its "personality" on the (otherwise too "impersonal") method 
of finite sections. In the previous example, for instance, one simply has to remove all 
elements from the sequence (5) that correspond to an odd value of n to get a stable 
approximation method for A (or alternatively, one could replace O = [—1,1] by [—2,2] 
and work with the whole sequence (5)). We believe that, for a given operator A, finding 
the right geometry f2 and an appropriate sequence m,n2, ■■■ of natural numbers such that 
the corresponding subsequence of finite sections P ni AP ni is stable (meaning that (4) is 
only expected to be uniquely solvable, with solutions u n convergent to u, for a particular 
sequence n = m, ri2, ■■■) is a major task in the numerical analysis of the equation Au = b. 

We will show that, under an additional condition on the operator A, the finite section 
subsequence (P ni ^4P n J^ 1 is stable iff A and every element from an associated set of 
operators is invertible and the inverses are uniformly bounded. We give a description of 
this associated set that depends on A, £1 and the sequence {rii) c ^ l . 

Strategy 2: Use rectangular instead of square systems. As an alternative ap- 
proach to the FSM (2), we discuss the slightly modified truncation scheme P m AP n u m>n « 
P m b, i.e. 

^ aij u mtn (j) w b(i), iettm, (6) 
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leading to rectangular instead of quadratic finite subsystems of Au = b that are now to 
be solved approximately instead of exactly. 

We prove that if A is induced by a matrix (aij) with ||ajj|| — » as |i| — >• oo for every j 
and if A is invertible then the modified method (6) is applicable. By the latter we mean 
that, for every e > and every b € E, there exist mo, no € N and a precision 5 > such 
that all (approximate) solutions of the rectangular system \\P m AP n u mtn — P m b\\ < 5 with 
m > mo and n > no are in the e-neighbourhood of the exact solution u of Au = b. 

We also discuss how the two truncation parameters m and n are to be coupled. 

Short History. The idea of the FSM is so natural that it is difficult to give a historical 
starting point. First rigorous treatments are from Baxter [1] and Gohberg & Feldman 
[3] on Wiener-Hopf and convolution operators in dimension N = 1 in the early 1960's. 
For convolution equations in higher dimensions N > 2, the FSM goes back to Kozak & 
Simonenko [7, 8], and for general band-dominated operators with scalar [15] and operator- 
valued [16, 17] coefficients, most results are due to Rabinovich, Roch & Silbermann. For 
the state of the art in the scalar case for p = 2, see [23]. 

The quest for stable subsequences if the FSM itself is instable is getting more attention 
recently [19, 20, 24, 25, 12]. In [20], the stability theorem for subsequences is used to 
remove the uniform boundedness condition in dimension N = 1. Also the consideration of 
rectangular finite sections, although not new in the numerical community, is now gaining 
more focus in the numerical functional analysis literature (see [6, 26] for Toeplitz operators, 
[24, 25] for band-dominated operators and [5] for even more general operators). 



2 Strategy One: Stable Subsequences of the FSM 
2.1 Preliminaries 

Let E = £P(Z N ,X), A 6 BBO(E) and O C R N be a valid starlike set as in Definition 
1.1. For an infinite index set I = {n±,n2, •••} Q N, we study the stability of the operator 
sequence 

(P n AP n + Q n ) n€X = (P ni AP ni + Q ni )Zx, (7) 

where we suppose that n\, ri2, ■■■ is a strictly monotonous enumeration of I. For the study 
of this sequence as one item, we will assemble it to a single operator. To do this, let 

_ f P TH APr H +Qn t , 

Ai - \ I, *€Z\N, (8) 

put E' := £ p (Z N+1 ,X), thought of as £P(Z,E), and write ®Ai for the map u \-+ v on E' 
with 

v(j,i) = (A iU (;i))(j), jeZ N , ieZ. (9) 

In other words, we think of u G E 1 as decomposed into layers u(-,i) € E, i £ Z, and let 
each Ai act on the i— th layer of u. We will therefore refer to Ai as the i— th layer of @Ai. 
One can show that then ®Ai & BDO(£")- 



4 



A key argument in [17], refined later in [9, 10, 18, 23], is that the stability of (7) is 
equivalent to ®Ai being invertible at infinity. Here we say that an operator B G BDO(-E') 
is invertible at infinity if there exist C,D G BDO(E') and an m G N such that CB@ m = 
Q m = @ m BD holds, where G m is the operator of multiplication by the characteristic 
function of Z Ar+1 \ {— m, m} N+1 . 

So it remains to study invertibility at infinity of 0^4j. This is done in terms of so- 
called limit operators [18, 2, 10]. The idea is to reflect the behaviour of an operator 
B G BDO(E') at infinity by a family of operators on E' and to evaluate this family. To do 
this, we need two notations. Firstly, for B,B±,B2, ... G BDO(£"), we write B = V'-limB n 
if [B n ] converges entry wise (in the norm of L(X)) to [B] as n — > oo and if sup n \\B n \\ < oo. 
Secondly, for a G Z N+1 , let : E' -» E' denote the shift operator with (V^u)(k) = 
u(k - a) for all k G Z N+1 and u G E' . 

If B G BDO(£'), h = (h(l),h(2), ...) C Z N+1 is a sequence with \h(n)\ -> oo and the 
operator sequence Ki^)^^/^) is "P'— convergent as n — > oo then its limit will be denoted 
by Bh and is called limit operator of B w.r.t. the sequence h. In an analogous fashion, one 
defines limit operators in BDO(-E). To distinguish between operators on E' and on E we 
write "P-lim and V a with a G Z N if we are in the E setting. Different sequences h generally 
lead to different limit operators and often the sequence V-h{n)BVh(n) does not V— converge 
at all. We will call B G BDO(-E') a rich operator if every sequence h = (h(l), h(2), ...) C 7, N 
with -4 oo has a subsequence g such that the limit operator B g exists. 

As a final preparation, we turn our attention to the geometry of £1. Let T := 50 be 
the boundary of O and, for every n G N, put 

T n := (nT + H) n Z N with F= (-1/2, 1/2 } N 



and then let 

For a sequence h = (h(l), h(2), ...) C Tj, 
5 C Z^, we call S the geometric limit of ft 
there exists a /cq G N such that 



■ IK 

say /i(/c) G r mfc for some G X, and a set 
w.r.t. /i and write S = £lh if, for every m G N, 



(O mfc -h{k)) fl {-m,...,™}^ = S n {-m,..,m} Ar , fe > fc - 

Note that in this case V-h(k)Pm k Vh(k) 1S "P— convergent to Ps as k — > oo. For a polytope 
O, the only candidates for the geometric limit S w.r.t a sequence h QTj are intersections 
of finitely many half spaces and Z N (discrete half spaces, edges, corners, etc.). 

2.2 The Stability Theorem for Subsequences 

Given a rich operator A G BDO(£) on E = i p (Z N ,X) with p G [l,oo], N G N and a 
complex Banach space X, a valid starlike set O, G K , and an index set I = {ni, ri2, ■•■} C 
N with ni < ri2 < • • • , we put 

Hn,z(A) := { h = (h(l), h(2), ...) : /i(/c) G Y x V/c, -)■ oo, A h exists, O h exists } 
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and 

:= {A} U {Pn h A h P nh + Q Qh : /, £ H Q ,z(A)}. (10) 
Then the following theorem holds. 

Theorem 2.1 Under the conditions mentioned above, the following are equivalent. 

(i) The sequence (P ni AP ni + Q ni )^i is stable. 

(ii) The operator ®Ai, with Ai as in (8), is invertible at infinity. 

(Hi) All operators in aff^{A) are invertible with their inverses uniformly bounded. 

Proof. See Theorems 3.1 and 3.5 in [12]. ■ 

For dimension N = 1, our statement coincides with a two-sided version of [20, Theorem 
3]. As such it generalizes [17, Theorem 3] (also see [18, Theorem 6.2.2], [10, Theorem 4.2] 
and [23, Theorem 2.7]) from the full sequence T = N to arbitrary infinite subsequences with 
index set ICff. For N = 2 and a convex polygon with integer vertices, our Theorem 
2.1, together with (10), corrects another version of the stability spectrum (see (11) and 
Example 2.2 below) that was previously suggested in the literature (see [17, 18]) for I = N. 
Moreover, our result demonstrates how to deal with subsequences I C N by restricting 
consideration to sequences h = (h(l), h(2), ...) with values in the set Tj = \J ne zT n . For 
dimensions N > 2, to our knowledge, the result is new - even in cases like I = N or Q a 
convex polytope. 



2.3 Examples 

As a particularly illustrative and not too difficult class of examples, we will look at oper- 
ators that are induced by an adjacency matrix. Therefore, put X = C, let £ denote a set 
of pairwise disjoint doubletons {i,j} (i.e. sets {i,j} = {j,i} with exactly two elements) 
with i,j € Z N , i ^ j, and put 

[ 1, if {i,j} £ £ or i = j <£ [j e, 
aij := < ee£ 
[ 0, otherwise, 

for all i,j £ 7j N . Then (a,ij) i j eZ N is the extended adjacency matrix of the undirected 
graph Q = (Z ,£) with vertex set 7j N and edges £. We write Adj(Q) for the operator 
that is induced by this matrix (a,j) and note that Adj(Q) is band-dominated iff b := 
snpuj\ e £ \i — j\ is finite, in which case Adj(Q) is even a band operator with band-width b. 

If applied to an element u £ E = l v (7L N \X), the operator Adj(Q) "swaps" the values 
u(i) and u(j) around if {i,j} is an edge of G, and it leaves all values u(k) untouched for 
which k £ Ij N is not part of an edge of Q. From this it is obvious that ||A<ij(C/)|| = 1 
and that Adj{Q) is invertible and coincides with its inverse. Moreover, it is clear that, 
for n £ N, the ra-th finite section P n Adj(Q)P n + Q n is invertible iff each edge e £ £ has 
either both or no vertices in £l n = n Z . In the latter case, P n Adj{Q)P n + Q n equals 
Adj(Q n ), where Q n = (Z , £ n f2^), is again its own inverse and has norm 1. So we get 
that, for A = Adj(Q), the sequence (7) is stable iff, for all sufficiently large n £ I, each 
edge e £ £ has either both or no vertices in Q n . 
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Note that Example 1.3 was already of the form A = Adj(Q), namely with N = 1 and 
£ = {...,{-4, -3}, {-2,-1}, {1,2}, {3, 4},...}. 

Here Q n separates the vertices of the edge {— n — 1, — n} and also of {n, n + 1} if n is odd. 

We continue with two examples demonstrating that two particular sets of operators 
that are closely related to <jQ 3b (A) - and that have, in the past, been suggested to replace 

(10) in the N = 2, I = N version of Theorem 2.1 - are actually not stability spectra 
(meaning that Theorem 2.1 is incorrect for I = N with afl 3b (A) replaced by any of them) 
if N > 1. These two "non-replacements" for <jQ 3b (A) are 

{A} U \J{Pn x BP Qx + Q nx : B G a°/(A)} (11) 

and 

{A} U \J{Pn x BP Qx +Qn x : B 6 a°%(A)}, (12) 

where V = <9Q and, for every x G T, Q, x C Z N is the limit of n(Q — x) n as n — > oo in 
the sense that, for each m G N, 

n(£l — x) D {—m, ...,m} N = $l x D {— m, m} N 

for all sufficiently large n G N. Finally, u° p (^4) is the set of all limit operators A/j of A 
with respect to sequences h = (h(l), h(2), ...) C Z w going to infinity in the direction x, 
i.e. h(n)/\h(n)\ — >• and o"° p ra y(^4) is the set of all limit operators A/j with respect 

to sequences of the form h = ([mi x], [ttt-2 x], ...) C where (m n ) is an unbounded 
monotonously increasing sequence of positive reals and [ • ] means componentwise rounding 
to the nearest integer. 

Example 2.2 Take N = 2, n = [-1, l] 2 and let A = Adj(G) with Q = {!?,£) and 

£ = {{(k 2 -k-l,k 2 ), (k 2 -k,k 2 )} : k = l,2, ... j. 

Then, with respect to to = fo(2), ...) with /i(A;) = (k 2 - k - l,k 2 ) G Z 2 , the limit 

operator of yl exists and is equal to B = Adj(Q'), where Q' = (z 2 , |{(0, 0), (1, • 

Since h(k)/\h(k)\ -)• with x = (1,1), we have that 5 G a° p (A). But ^ = {...,-l,0} 2 
separates (0,0) from (1,0) so that Pq, x BPq, x + Qq x G (11) is not invertible. However, the 
whole finite section sequence (5) is stable since all edges e G £ have either both or no 
points in Q n , so that P n AP n + Q n = Adj(Q n ) with Q n = (Z 2 ,£ n f] 2 ) for every n G N. So 

(11) is not a valid replacement of (10) as stability spectrum. 

Note that the element of (10) that corresponds to the limit operator B = Ah of A is 
Pn h BPn h +Qn h with n h = Zx {...,-1,0} instead of {...,-l,0} 2 , which is again equal to 
B (since both (0,0) and (1,0) are in fi^) and hence invertible. □ 

Similarly, we can rule out (12) as stability spectrum by the following example: 

Example 2.3 Again take N = 2, O = [-1, l] 2 and let A = Adj{Q) with Q = (Z 2 , £) and 

£ = U(k 2 -k,k 2 ), (k 2 -k,k 2 + l)} : k = 1,2, ... j. 
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Then, with respect to h = (h(l), h(2), ...) with h(k) = (k 2 — k, k 2 ) G Z 2 , the limit operator 
of A exists and is equal to B = Adj(G'), where Q' = (z N , |{(0, 0), (0, 1)}}) • 

Again B G a°?(A) with x = (1, 1). But B £ o"°^ ray (^4) neither is B in a y ray (A) for any 
other y G T! In fact, it holds that cr^ ray (A) = {/} for all y G T, whence (12) is elementwise 
invertible with uniformly bounded inverses. However, the finite section sequence (5) is not 
stable since Cl n separates (k 2 — k, k 2 ) from (k 2 — k, k 2 + 1) if n = k 2 . So also (12) is not a 
valid replacement of (10) as stability spectrum. 

Note that, for I = N, (10) contains the operator P^ h BPQ h + Qn h with = Z x 
{...,— 1,0}, which is non-invertible since fi^ separates (0,0) from (0,1). This operator is 
however removed from (10) if we remove all (sufficiently large) square numbers from I, 
which matches our observation that P n AP n + Q n is non-invertible iff n is a square. □ 

It is clear that Examples 2.2 and 2.3 can easily be heaved to dimensions N > 2. Let 
us look at another example, for simplicity also in dimension N = 2. 

Example 2.4 We look at A = Adj{Q) for Q = {!?,£), where 

S = {{(fc.l), + : fc = l,2,...}. 

It is not hard to see that every limit operator of A is either the identity operator / or the 
operator B = Adj(Q') for Q' = {!?,£' ), where 

£' = {{(M), (* + i.o)} : fcez}, 

or it is a translate of -B. Looking at B and noting that B = A^ for all sequences h = 
(h(l), h(2), ...) with h{k) = (m^, 0) and — > +oo, we can say how f2 has to look locally 
at the intersection z of its boundary T with the positive x-axis in order for the finite 
section method to be stable. Here the upward tangent of T at z has to enclose an angle 
a G (90°, 135°] with the positively directed x-axis. So, for example, the finite section 
sequence is stable if f] is the square conv{(l, 0), (0, 1), (— 1, 0), (0, — 1)} or the triangle 
conv{(0, 2), (2, —2), (—2, —2)}, whereas it does not even have a stable subsequence if Q is 
the square [— 1, l] 2 . □ 

The next example is closely related to Example 1.3. 

Example 2.5 a) Let A = Adj{Q) where Q = (Z,£) is the following infinite graph: 

1 



Then, no matter how we choose O = [a, b] with integers a < < 6, the finite section method 
does not even have a stable subsequence. A workaround would be to take Q = [—1,1) 
or to increase the dimension to N = 2, where we place the edges £ along the x-axis and 
put Q = conv{(— 1, 0), (1, 1), (0, — 1)}, for example. In the latter case, the finite section 
subsequence corresponding to 1 = 4N + 1 turns out to be stable. 

b) In contrast to a), there is no workaround whatsoever if A = Adj(Q) with the 
following graph Q (embedded in dimension N = 1 or higher): 
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For every valid starlike set and every n € N, the set £l n separates the endpoints of at 
least two edges of Q so that P n AP n + Q n is non-invertible. □ 

For any dimension N € N, any valid set € and any given sequence m < 77,2 < 
• • • of naturals, one can construct a graph Q in the style 1 of Example 2.5 b) such that 

{PnAPn + Qn)n 

6 i is stable iff X is a subset of {ni,n 2 , ...}. 



2.4 Some Words on the Case N = 1 



Not surprisingly, the results are most complete in dimension N = 1, where one can sharpen 
and extend much of what was said previously (also see [20, 21, 24, 25, 12]). This is clearly 
due to the simple geometry of this setting: Firstly, to infinity there are only two ways to 
go: right or left, and secondly, all valid starlike sets are intervals from a to b with reals 
a < < b so that there are only two possibilities for D, n in (10): {0, 1, ...} and {..., —1,0}. 

The main result on N = 1 is by Rabinovich, Roch and Silbermann. It highlights an 
important benefit from extending the stability theorem from the full finite section sequence 
to subsequences. A proof can be found in [20] or, slightly generalized, in [12, §6]. 

Proposition 2.6 [20] The uniform boundedness condition in Theorem 2.1 (Hi) is redun- 
dant if N = 1. 



As a next result in dimension TV = 1, we mention that if the full FSM (5) is stable for 
one valid f2 then (5) has a stable subsequence for all valid Q. So conversely, if there exists 
a valid O for which (5) has no stable subsequence then there is no valid £1 for which the 
whole sequence (5) is stable. A proof can be found in [12, §5]. 

Example 2.5 b) has shown that, for some operators, the finite section method cannot 
be "adjusted", via choosing f2 and I, to become stable. We now give a necessary criterion 
for the existence of an index set ICN and a valid fi such that (7) is stable. 

Proposition 2.7 Let E = £ P (Z,C) with p G [l,oo] and A G BBO(E). For the existence 
of a valid starlike set £1 C K and an infinite index set I C N such that the sequence 
(P n AP n + Q n )n£i is stable it is necessary, but not sufficient, that A is invertible and the 
Fredholm index ind+(A) := ind(PN^4-PN|i m p N ) is zero. 

A proof, based on work on the Fredholm index of band-dominated operators in [14], 
can be found in [12, §5]. In [13] (see [22, 11] for p 7^ 2) we have shown that, under the 
additional condition that all diagonals of [^4] are slowly oscillating, invertibility of A and 
ind-|_(A) = are even sufficient for the stability of the full finite section sequence (5) for 
all valid Q. Here we call a sequence (bk)kez slowly oscillating if — b^ — > as k — >■ ±00. 

lr The idea is to take the graph from Example 2.5 b) and to place "gaps" between <ii := \arii \ and a, — 1 
and between fo; := [brii] and bi + 1 for i — 1,2, where a < and b > are the unique intersection points 
of r = dil with the x-axis and [•] and |_-J stand for rounding up and down to the next integer, respectively. 



9 



Remark 2.8 By Proposition 2.7, for an invertible operator A with k := ind+(A) ^ 0, 
there is no valid 0, and no index set I C N for which (7) is stable. This problem of a 
nonzero plus-index k can be overcome as follows: Instead of solving Au = b, one looks at 
V K Au = V K b with V K as in Example 1.2. Since V K is invertible, these two equations are 
equivalent. Moreover, also A' := V K A is invertible and 

md + (A') = md + {V K A) = ind+(K) + ind+(A) = -k + k = 0. 

This preconditioning-type procedure of shifting the whole system (all matrix entries and 
the right hand side b) down by k rows is reminiscent of Gohberg's statement that, in a 
two-sided infinite matrix, "it is every diagonal's right to claim to be the main one" (see 
page 51f in [4]). Our results show that, however, from the perspective of the FSM, there 
is one diagonal that deserves being the main diagonal a bit more than the others. □ 

3 Strategy Two: Rectangular Subsystems 
3.1 Motivation 

Let us go back to Example 1.2 and try to fix one of the basic problems of the FSM. For 
simplicity, think of dimension N = 1 and Q = [—1,1] so that f2 n = {— n, ...,n} for all 
n € N. Look at the shift operator A = Vk with k = 1, say. The FSM for the solution of 
Au = b, that is 

P n AP n u n = P n b, n= 1,2,..., (13) 

thinks of an approximate solution u n with support in {— n, n}, then applies the operator 
- in our case the forward shift by 1 component - and afterwards cuts off at {— n, ...,n} 
again, hereby trying to match the restriction of the right-hand side b to {— n, ...,n}. It is 
clear that this truncated equation (13) is in general not solvable since the left-hand side of 
(13) always has a at component — n whereas the right-hand side has the same component 
— n as b has. Even if b(—n) = and (13) is solvable then the solution u n is not unique 2 
since its nth component got shifted and then cut off whence it is irrelevant for (13). 

The observation generalizes to band and band-dominated operators of course. If we 
truncate u n at {— n, ...,n} and apply a band operator A with band-width w then AP n u n 
is supported in {— n — w, ...,n + w} whence, for the same reasons as illustrated for the 
shift A = V\, it is better to cut off at {— m, m} with m = n + w and not at {— n, n}. 
The resulting system 

P rn AP n u n = P m b, n = l,2,.., (14) 

with m = n + w is over-determined - it has rectangular matrices that have 2w more rows 
than they have columns. But one can still try to solve it approximately (by least squares, 
say). 

Of course, for a finite quadratic system, solvability for all right-hand sides (i.e. surjectivity of the finite 
matrix operator) is equivalent to uniqueness of the solution (i.e. injectivity). The approach here is to say 
that lack of surjectivity can be overcome by looking for approximate rather than exact solutions, whereas 
lack of injectivity is a more serious problem that will be dealt with by adding more equations (i.e. more 
matrix rows) to the finite system. 
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From the matrix point of view, [AP n ] is the same as [A], only with all but columns 
number — n, ...,n put to zero. If the horizontal cut-off [P m AP n ] (that one also has to do 
to get a finite system for the computer) is done at m = n, like in (13), then some 'large' 
entries of L4P n ] will get cut off (recall A = V\) which might cause problems as mentioned 
earlier; so it could be good to choose m a bit larger. In fact, if A has the property 

\\P m AP n -AP n \\ -> 0, i.e. ||Q m AP n || -> as m -¥ oo (15) 

for all n 6 N then it seems possible to work with this rectangular cut-off idea, where m in 
(14), depending on n, is chosen large enough to make ||P m AP n — AP n || = ||Q m AP n || small 
enough. The class of operators with property (15) clearly contains all of BDO(£'). 

The above idea is so natural that it can hardly be new. Indeed, it is already used by 
some of the numerical community and it goes back at least to the 1960's when Cleve Moler 
suggested, roughly speaking: If square submatrices give you problems, make them higher 
and use least squares. In [5] we have not only reinvented this method, we have (and that 
seems to be new) given a proof that, in the setting of a rather general Banach space E, 
the method is applicable as soon as A is invertible and subject to (15). We will now recall 
the main steps of this proof. 

3.2 The Rectangular Finite Section Method (rFSM) 

We will work with the same spaces E = £ P (Z , X) and the same projection operators 
P n and Q n here as defined above, but we will now exclude the case p = oo because we 
require strong convergence P n — > I, i.e. P n u —> u for all u £ E, as n — > oo. The subspace 
cq(Z n , X) = {u G e°°(Z N , X) : P n u ->• u} of £°°(Z N , X) is however a valid choice for E. 

Now suppose A : E — > E is a bounded and invertible linear operator with (15), that 
means ||ajj|| —> as \i\ — > oo for every fixed j € Z N , where [A] = (a^) is the matrix 
representation of A. Then the equation Au = b has a unique solution u =: uq for every 
right-hand side b 6 E. For the approximate computation of uq we propose the following 
method: For given precision 5 > and cut-off parameters m and n € N, calculate a 
solution u € im P n of the inequality 

\\P m AP n u - P m b\\ < 5. (rFSM) 

We start with a result about the existence of solutions of (rFSM). 

Definition 3.1 We say that iiq G N is an admissible n-bound for A, b and a given 
precision 5 > if (rFSM) is solvable in E for all m € N and all n > uq. 

Proposition 3.2 For every 5 > 0, there is an admissible n-bound uq £ N. 

Proof. We demonstrate how to choose no so that u := P n UQ = P n A~ l b solves (rFSM) for 
every n > no- For all m £ N and n € N, we have 

\\P m AP n u - P m b\\ = \\P m AP*A- l b - P m b\\ 

< \\P m AA^b - P m b\\ + \\P m AQ n A^b\\ 

< + \\A\\ -WQnA-'bl 
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But, by our assumption Q n — > 0, there is a no € N such that 

IIQ^-^H < ^ (16) 

for all n > no, so that \\P m AP n u — P m b\\ < 5 holds, and hence u solves (rFSM) for all 
n > no and m G N. ■ 



Lemma 3.3 Let no G N be an admissible n-bound for A, b and a given precision 5 > 0. 
If n > no and m G N are saca i/iai ||<5 m ^4P n || < Vll^~ || £aen i/te set o/ a// solutions of 
(rFSM) is a bounded subset of E. Precisely, every solution u6imP n o/ (rFSM) is subject 
to 1 1 -ix 1 1 < M mta M given by (17). 



Proof. Suppose u G im?„ solves (rFSM) for given parameters 6,m,n. Then 

\\Au\\ - \\P m b\\ < \\Au-P m b\\ = \\AP n u - P m b\\ 

< \\AP n u - P m AP n u\\ + \\P m AP n u - P m b\\ 

< \\Q m AP n \\ ■ \\u\\ +5 

together with ||n|| < H^" 1 ]] • \\Au\\ implies that 
\\u\\ 

< \\Au\\ < ||P m »|| + ||Q m AP re ||-||tt||+<5 
< H&ll + \\Q m AP n \\ ■ \\u\\ +5 

and hence 

II II < M ll^ll + $ , 17 x 

M - •= i/p-ii - \\Q m AP n \y (17) 

■ 

Now we are ready for the key result showing that every solution of (rFSM) is indeed 
close to the solution no of Au = b. 



Theorem 3.4 For every e > 0, there are parameters 5, m, n such that every solution u of 
the system (rFSM) is an approximation 

\\u — uq\\e < £ (18) 

of the exact solution uq of Au = b. Precisely, there are three functions 5q : M+ — > R+, 
no : R+ — > N and mo : xN^M such that if 5 < 5q(e) , n > no(5) and m > m-o(e, 5, n), 
then every solution u G imP n of (rFSM) is subject to (18). 



Proof. Let e > be given. We start the proof with three preliminary steps. 

(a) Choose 5 < 5$ := gn^Li,, . 

(b) Choose no G N such that (||Q n ^o|| = ) IIQn^l" 1 ^! < -pjy for all n > no, so that no is 
an admissible n-bound for 5 (see inequality (16)). Now let n > hq. 
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(c) Choose ttiq € N such that both ||Q m 6|| < 3||^-i|[ an d 

WQmAPj < j-^ ( 1 - 1 - ) (19) 

11/1 11 V i+ 3(||6||+i)-||A-i||/ 

hold for all m > uiq, and fix some m > m,Q. 

Now let u € im P n be a solution of (rFSM) with parameters 5, n and m as chosen above. 
From (19) we get ||Q m AP n || < 1/||A _1 ||, and hence, by Lemma 3.3, 

HI < M ( 20 ) 
with M as defined in (17). Moreover, inequality (19) is equivalent to 

1 3{\\b\\+sy\\A-^\\ 



WQmAPj < 

II 71 II 1 sdifeH+s)-^- 1 ! 



and hence to 



3(\\b\\ +5) ■ WA^WJ n ^" L HA- 1 !! 3(||b||+<5)- p- 1 !!" 
This, moreover, is equivalent to 

WQmAPj < • 3( || b || - 5) . " 3 (|| b || . p=ljj • WQrnAP n \ 

e(l/\\A~ l \\ - \\Q m AP n \\) e 



(21) 



3(||6|| +5) ■ 11^4— 1 1| 3MIIA- 1 !! 
with M as defined in (17). Then we have 

1 1 ia — ia 1 1 = \\PnU-u \\ = WA' 1 AP n u - A^b\\ < \\A~ l \\ ■ \\AP n u - b\\ 

< WA^W ■ (\\AP n u - P m AP n u\\ + \\P m AP n u - P m b\\ + \\P m b-b\\) 

< \\A- l \\ ■ (\\Q m AP n \\ ■ \\u\\ + 5 + ||Q m 6||) 

see 

< 3 + 3 + 3 = £ ' 

using inequalities (21) and (20) and the bounds on 6 and ||Q m 6|| in the last step. ■ 

Remark 3.5 One way to effectively solve the system (rFSM) for given parameters m,n 
and 5 is to compute a u € imP n that minimizes the discrepancy in (6), for example using 
a gradient method or, if possible, by directly applying the Moore-Penrose pseudo-inverse 
B + of B := P m AP n to the right-hand side P m b. 

If E is a Hilbert space (i.e. if p = 2 and X is a Hilbert space) then it is well-known 
that u € imP n minimizes the residual \\Bu — P m b\\ if and only if B*(Bu — P m b) = 0. If, 
in addition, P m is self-adjoint for all m G N, then, after re-substituting B, the latter is 
equivalent to 

P-nA P m AP n u = P n A P m b. (22) 
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However, if m is sufficiently large, then, by (15) and P n — > I, the equation (22) is just a 
small perturbation of 

P n A*AP n u = P n A*b, (23) 
which is nothing but the finite section method for the equation 

A*Au = A*b. (24) 

Note that the finite section method (23) is applicable since A* A is positive definite (see, 
e.g. Theorem 1.10 b in [4]). Clearly, if A is invertible, as we require, then also its adjoint 
A* is invertible, and (24) is equivalent to our original equation Au = b. 

Summarizing, if E is a Hilbert space and all P m are self-adjoint, then minimizing 
\\P m AP n u — P m b\\ is equivalent to solving a slight perturbation (22) of the finite section 
method (23) for (24). □ 



4 Summary 



Compared to the FSM and its subsequence version fully characterized in Theorem 2.1, the 
rFSM imposes no further conditions on the operator A (such as richness, conditions on its 
limit operators, etc.) other than its invertibility and the rather mild decay property (15). 
Of course, on the down side, we are restricted to p < oo, and, more seriously, for general 
operators A we do not really know yet how to choose m in dependence on n. However, 
the choice m = n + w is clear for operators with band-width w, and something similar 
is possible for a band-dominated operator A (where w must be fitted to the function /a 
from [10, p. 32ff]). In contrast, in [5] we have chosen m = |n. 

We close with the following example. 



Example 4.1 Let E = £ 2 (Z,C), b 
be given in block matrix notation by 



,4 



(fc(i))iez G E with b(i) = 2~W, and let A : E ->■ E 



B C 
B C 

B 



\ 



where 



B 




and 



C 




and where one of the B blocks is located at position : i,j € {—1, 0, 1}} in A. Then 

A is a band operator with band-width w = 3, it is invertible but has a nonzero plus-index 
ind+(.A) = ind(PNj4Ppj|im Pn) = 1- From Proposition 2.7 we know that there is no choice 
of f2 and 1 C N that makes the FSM (7) for Au = b stable. But Remark 2.8 shows that 
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passing to the equivalent system V\Au = V\b might solve this problem since A 1 
has plus-index zero. This approach leads us to looking at finite sections of 



( 



A' = ViA 



\ 



D 



D 



D 



\ 



with D 




and one of the D blocks located at position '■ i,j € {—1, 0, 1}} in A'. For 0, = [—1, 1], 

we get that of$(A') = {A', F, G, H, J, K, L}, where 



diag 



,1,1, 



1 




A A • • • 



J = diag 



A A 



G = diag(--- ,1,1, •••), i^ = diag 

F = diag(--- ,1,1,0, A A •••), i = diag( 



1 1 
1 1 

■ ,AAAM,---) 
,AAM, !,•■•) 



with the underlined l's at position (—1, —1) and the overlined l's at position (1, 1) in the 
respective matrix. Out of the seven elements of afy^(A') only A', G, K and L are invertible 
(noting that D is invertible). Looking at certain index subsets X of N, we see that 

<3n(^') = K, F, J}, <3N+i(^) = M 7 > G, K}, a%% +2 (A>) = {A', H, L}, 

so that the set 1 = 3N + 1 yields a stable subsequence (7), whereas 3N and 3N + 2 don't. 
After these considerations (shift the system by 1 row, single out a stable subsequence) it 
is now straightforward to approximately solve the equation via the FSM. 

In contrast, the rFSM immediately applies to Au = b if we choose m = n + 3 (since 
A has band-width w = 3) and solve the systems P n+ ?,AP n u ~ P n +2,b approximately for 
n = 1,2, ... using the Moore-Penrose pseudo-inverse of P n +3AP n . The latter means that 
we compute 

u n := (P n+3 AP n ) + P n+3 b, n = l,2,... 

and get that u n (if extended by zeros to an infinite vector) converges to the exact solution 
«o = A~ l b with 



"0 



< 
< 



\A~ 



IP, 



n+3 



AP n u n 



3 • 2 



+ 



2 n+3 



Pn+M + ||Qn+3&||) 
49 



2«+2 ' 



which follows from the computations in the proofs of Proposition 3.2 and Theorem 3.4 
together with \\A\\ < 3 and 1 1 ^4 1 1 1 < 2. □ 
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